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DESIGN BY SPACE TRANSFORMATION FROM HIGH TO LOW DIMENSIONS 
Field of the Invention 

This invention concerns design by space transformation from high to low 
dimensions. More particularly but not exclusively, this invention concerns 
methods and systems for design by transforming data from a high to low 
dimensional design space. 
Background of the Invention 

There are considerable cost benefits to be derived from improving designs 
both by better searches in current design spaces and by satisfying more complex 
design criteria, for instance by striking the right balance between multiple 
objectives from the same discipline or from different disciplines. 

In known design processes designers typically spend a prohibitively long y 
time preparing individual analysis cases and, are constrained to sampling small 
areas of the design space close to previously explored regions. In such a design . 
processes, complex design tasks are broken down into manageable portions so 
that specialists in individual disciplines can resolve different parts of the design. 
However, such portions are too small and there is too much iteration between 
disciplines which prohibits the challenging of the constraints of one discipline by 
another, where the most progress is likely to be made. Furthermore, known 
design space exploration techniques as applied to complex multi-dimensional 
design spaces are invariably inefficient on account of the associated high 
computational processing cost required for the data analysis. Also, such 
techniques can be problematic to use in complex multi-dimensional design 
spaces because these typically rely on simplistic data analysis models involving 
different parameters - for example, numerical errors or uncertainties associated 
with discretisation, incomplete convergence, irregular constraint boundaries can 
arise. The inventors have . recognised that this situation can be ameliorated- if 
small numbers of individuals can assimilate, appreciate and understand large 
amounts of data rapidly and efficiently. With this in mind, this inventive work is 
aimed directly at the designers in the design process of the future,: who 
communicate with and steer the design search and optimisation process and who 
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can extract previous work from databases transparently and flexibly. They can 
use software and data as web services, so that the source of this data and 
software becomes unknown and unimportant. Such designers make use of high 
cost analysis codes within automated search and response surface models to 
map and optimise domains using computationally expensive evaluations. They 
can use low fidelity (or computationally inexpensive) models to navigate high 
fidelity design spaces. The placement of analyses in the design space are 
defined by design of experiments (DoE) methods both as schemes defined a 
priori and as a result of optimisation or error-defining processes. These 
engineers, armed with more information and understanding, can be expected to 
regularly challenge cross-discipline constraints. They are more concerned with 
problem definition, design space shape and optimisation than how any one 
analysis is obtained and use advanced visualisation techniques to provide 
enhanced comprehension and effective navigation of hyper-dimensional design 
spaces. 

Objects and Summary of the Invention 

The present invention aims to overcome or at least substantially reduce 
some of the above mentioned drawbacks associated with known processes. 

It is an object of the present invention to provide a method and system 
which are reliable for providing enhanced comprehension and effective 
navigation of multi-dimensional design spaces. 

In broad terms, the present invention resides in the concept of 
transforming data from a high-dimensional to low-dimensional design space and, 
by inspecting the transformed data in the low-dimensional design space, enabling 
an optimum value for a functional representation of the transformed data to be 
established, and thereby permitting effective exploration of the high-dimensional 
design space. 

According to a first aspect of the present invention there is provided a 
method of transforming data from a high-dimensional to low-dimensional design 
space and deriving an optimum value for a predetermined function representative 
of the transformed data in the low-dimensional design space, which derivation is 
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further effected in the low-dimensional design space in dependence upon an 
inspection of the transformed data. 

. According to a second aspect of the present invention there is provided a . 
method of transforming data from a high-dimensional to low-dimensional design 
space, and deriving a conditional value for a predetermined function 
representative of the transformed data in the low-dimensional design space, 
which derivation is further effected in the low-dimensional design space in 
dependence upon an inspection of the transformed data. 

It is to be understood here that the terms "optimum value" and "conditional 
value" herein are interchangeably used insofar as they are intended to 
correspond to the highest or lowest value of the functional representation of the 
transformed data in the low-dimensional design space, the particular various 
constraints to the design space problem being further satisfied at the same time. 

In accordance with an exemplary embodiment of the invention which will 
be described hereafter in detail, the optimum/conditional value is derived by (a) 
establishing a mathematical combination of a number of independent design 
variables and dependent design variables relating to the function, and (b) 
modifying the combination in the low-dimensional design space to derive 
therefrom the desired value for the function at which various constraints 
associated with the function are satisfied and at which the function has a 
conditional high or low value in relation to other possible values of the function 
which are determined in accordance with the modification of said combination. 

Conveniently, the transformation into the low-dimensional design space is 
performed by application of a Generative. Topographic Map (GTM) technique. It 
is to be appreciated that alternative transformation techniques, the self- 
organizing map (SOM) after Kohonen [13], for example, could be used instead 
for this particular application. 

In accordance with another embodiment of the invention which will be 
described hereinafter in detail, the method-comprises the step of transforming 
data from a first high-dimensional design space and from a second, different 
high-dimensional design space into a low-dimensional design space, comparing 
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the different transformed data sets in said low-dimensional design space and 
identifying therefrom similarities between the different transformed data sets to 
indicate a correspondence between the first and second high-dimensional design 
spaces. This provides an effective way of assessing the importance and inter 
relationship of design variables in different high-dimensional design space 
problems. In this embodiment, to be described hereafter, the first high- 
dimensional design space is a 5-dimensional design space, the second high- 
dimensional design space is an 8-dimensional design space, the third high- 
dimensional design space is a 14-dimensional design space, and the low- 
dimensional design is a two-dimensional design space. It is to be appreciated, 
however, that various other kinds of high-dimensionality design space can be 
readily accommodated, if desired. 

Advantageously, the data transformation into the low-dimensional design 
space is performed in a manner which takes account of the effect of each of the 
design variables relating to the function. This makes optional the need for any 
pre-screening of the design variables. 

Optionally, the optimum/conditional value derivation is effected by 
generating an image map representation of the transformed data in the low- 
dimensional design space (for example, a 2-D image map representation may be 
generated), and visually identifying an intersecting region in the image map 
representation, which intersecting region provides an indication of said value. It 
is to be understood that the identification step could be performed 
computationally, if desired, so as to provide the required technical effect. 

The invention has utility for aircraft design applications and although this 
technology has been developed with reference to aircraft aerodynamic design in 
particular, the design space visualization and curve fitting technology developed 
is general. It should therefore be equally applicable to other disciplines such as 
cost analysis, structures and computational electromagnetics, in which expensive 
analysis tools are used to find optima for complicated design problems. It is 
expected to be particularly useful in multi-disciplinary design and situations where 
there are multiple optima in the design space. 
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It is to be appreciated that the present invention may be embodied in software. 
Accordingly, the present invention extends to a computer program element 
comprising program code for configuring a programmable device apparatus or 
system to implement the above described method. Suitably, the computer 
program is stored on a carrier medium. 

Further, the present invention extends to a data processing system or 
apparatus for transforming data from a high-dimensional to low-dimensional 
design space adapted and arranged to implement the above described method. 

The above and further features of the invention are set forth with 
particularity in the appended claims and will be described hereinafter with 
reference to the accompanying drawings. 

Rrief Description of th e Drawings -» 
Figure 1 shows a schematic representation of an RSM-Based Design 4 
Process; 

Figure 2 shows an image representative of a design space for an 
analytical function; 

Figure 3 shows a series of conventional scatter plots; 

Figure 4 shows a set of self-organising maps for a 2-D analytical problem; 

Figure 5 shows an alternative image representation of the image of Figure 

20 2; 

Figure 6 shows the typical result of transforming the image representation 
of Figure 5 into a triangle; 

Figure 7 shows the typical result of transforming the image representation 
of Figure 5 into an SOM; 

Figure 8 shows the typical result of transforming the image representation 
of Figure 5 into a GTM; 

Figure 9 shows the typical result of a 50 x 50 evaluation. of a. 2-D. design space 
using a 2-D panel method; 

Figure 1 0 shows a series of scatter plots for a 5-D military aircraft problem; 
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Figure 1 1 shows a set of self-organising maps for a 5-D military aircraft 
problem; 

Figure 12 shows a 5-dimensional Hierarchical Axes Technique plot; 

Table 1 shows a typical set of results for design space optimisation as 
obtained form the Kriging Process; 

Table 2 shows a set of results corresponding to Figure 13 for design 
space optimisation, as obtained from GTM optimisation for a 5-D problem; 

Figure 13 shows an image map representation of transformed data in 2-D 
design space, in accordance with an embodiment of the invention; 

Figure 14 shows a loading distribution plot of optimised wing design 
corresponding to an inventive application of an embodiment of the present 
invention; 

Figure 15 shows an image map representation of transformed data in 2-D 
design space, as obtained from GTM transformation of an 8-D aerodynamic 
problem; 

Figure 1 6 shows another image map representation of transformed data in 
2-D design space, as obtained from GTM transformation of a 14D aerodynamic 
problem; and 

Figure 17 shows how points on a regular grid in low-dimensional space 
are mapped using a non-linear mapping to corresponding centres of Gaussians. 

Detailed Description of Exemplary Embodiments 

This invention is to be described in the following way. The 
application of visualisation and design space transformation on a two- 
dimensional analytical problem is described and then extended for use in military 
aircraft design. A two dimensional visualisation of a representative military aircraft 
problem is described and then extended to 5, 8 and 14 dimensions. The 
description includes a specification of the optimisation problems and a modus 
operandi for a design process is introduced. The visualisation is compared to 
alternative techniques, such as scatter plots and SOM visualisations. Possible 
applications of the different visualisation methods, in conjunction with response 
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surface method technology, are also described. The proposed inventive process 
whereby the transformed design space is then used to obtain the optimum in the 
design space is explained. The proposed process and usual process are 
compared for the 5-D problem. It is shown how by implementing the proposed 
process the solving and understanding of multi-dimensional design spaces ban 
be effectively performed in a two-dimensional image. 

Mndus Operandi 

It is to be appreciated that the large amounts of data required for 
design space appreciation can be provided by response surface method 
technology. Visualisation is part of a modus operandi, as shown in Figure 1 . This 
comprises first, a problem specification, in terms of objectives, constraints and 
design variables. Then a DoE (e.g. Latin Hypercube [3], LP, [4]) is performed and 
a response surface methodology applied (for instance kriging, radial basis 
functions [5,6,7], etc.). An update strategy is then determined by statistical 
methods, such as expected improvement or the optimum in the domain based on 
the visual inspection of maps. As part of this process an assessment takes place 
as to the importance of the design variables in the problem. The inventors have 
found that the first visualisation method proposed ceases to work after about 6 
dimensions. The inventors propose to transform the spaces described from high 
dimensions (5, 8 or 14-D in this case) to just two or four dimensions by use of the 
generative topographic map (GTM) (although the exact dimensionality of the low 
dimensional transform is optional). 

As previously mentioned, the invention is described hereinafter by use of 
two example problems. First, a simple two-dimensional analytical problem, from 

Schwefel's book [1] as described. Secondly, a military aircraft optimisation in 2, 5, 

8 and 14 dimensions is described. More conventional design space appreciation 

and response surface fitting methodology is also described. 

Analytical Problem Specification 

A two-dimensional analytical function is chosen so that full appreciation of 

the design space and comparison with the transformations is possible. It is 
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assumed that if transformations are poor in two-dimensions then their application 
in higher dimensions will be even worse. 

The analytical problem is shown in Figure 2 where the objective function 
(Ob) and the constraints (C? to C 7 ) are defined as: 

OK*)— 

C 2 (x) = -x 2 

C 3 (x) = -x? - x 2 2 +17.0x, +5.0x 2 -66.0 
C 4 (x) = -x, 2 -x 2 2 + l O.Ox, + 1 0.0x 2 - 41 .0 
C 5 (x) = -x, J -Xj 2 +4.0x, +I4.0x 2 -45.0 
C 6 (x) = x 1 -7.0 
C 7 (x) = x 2 -7.0 

In this definition, a constraint is considered satisfied if it is <o.o. The 
objective function is not drawn in the domain where any of the constraints are 
violated. The traces show all the evaluations made using an SQP optimisation 
method from multiple starts along the line x, = 3.o The SQP method used was by 
Madsen [1] and based on the Harwell Library Subroutine VE02AD. Alternative 
starts, for example along thex,=o.o line also find the optimum at [0.5]. The 
problem lies in being able to extend plots like this to multiple dimensions. 

The results achieved for this optimisation depend on which constraints are 
active when the problem is solved. The four possible local minima occur where 
the constraint boundaries intersect: 

• x = (0,5), Ob(x) = -25, constraints 1 and 5 active; 

• x = (2.1 16,4.174), Ob(x) « -21.90, constraints 4 and 5 active; 

• x = (5, 2), Ob(x) = -29, constraints 3 and 4 active; 

• and x = (6, 0), 0£(x) = -36, constraints 2 and 3 active. 

The global optimum, the optimum of all the local optima, is at 

x = (6,0), Ob(x) = -36, with constraints 2 and 3 active 

A good SQP algorithm would be one which would find all the local optima 
at intersections of the constraint boundaries and then the designer would inspect 
these and find the best answer from them. At this point he may also wish to take 
additional considerations info account. * 
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Additional plots can be used to further interrogate the data. First, a series 
of scatter plots can be drawn as shown in Figure 3, in which every item of data 
can be plotted against every other item of data that is, of every dependent and 

5 independent variable of interest against every other variable. Scatter plots are 
widely used by the statistics community, see for example [10]. These plots 
enable a good appreciation of the design space and to establish whether or not 
known trends are being followed. This process confirms for instance the nature of 
the design of experiments (DoE). Here, design variable 1 and design variable 2 

10 are chosen at every comer point of a mesh, which subdivides the design space 
equally. The quadratic nature of the constraints is also discernible. Alternatives to 
this include parallel co-ordinates [11, 12] or SOM's). These latter methods also 
enable relationships between variables to be obtained [14] and, possibly, to 
establish the most important variables in the problem. 

15 Figure 4 shows a set of SOM's for this data. The directions of xi and x 2 

are horizontal and vertical respectively, showing that they are orthogonal in the 
design space. The objective (-Xi 2 -x 2 2 ) is monotonically related to c 2 as the 
diagonal lines go in the same directions and the colour changes from bottom left 
to top right, x* and ci are shown to be inversely related as the colours are in the 

20 opposite directions, but still horizontal in both maps. Similarly c 3 is inversely 
related to x 2 . The functions Ci, c 2 , c 3 and the objective are all circular. (See U.K. 
patent application No. 0228751.4). 

Although the SOM appears to be able to detect relationships between 
functions it does not facilitate the scrutiny of play off between domain constraints. 

25 In addition the location of function minima is also desirable, along with tracking 
the paths of optimisations. These properties can all be identified, for a 2- 
dimensionai problem in Figure 2. An alternative representation of Figure 2 is 
shown in Figure 5. Note that in the Figure the feasible region is denoted by the 
white circles and the infeasible by the black circles. The full extent of the 

30 constraints is also shown. Thus, the complete domain is shaded and the feasible 
and infeasible regions are determined by the colour of the circles. The circles 
represent the DoE and are drawn for every other point in the design space. The 
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complete extent of the constraints is shown. This representation follows the 
annotation of Grossman et al [16] f in which a 28 dimensional space is 
represented as a triangle. The triangle in [16] is a mapping of 28 dimensional 
vectors into 2-D, 3 points are chosen to form the comers of the triangle. These 
may be local optima or perhaps two local optima and one intermediate point. All 
the intermediate points are then obtained as being a certain distance away from 
these reference points. The actual objective and constraints are then plotted as 
usual in a 2-D plot. A fourth reference point would then be required to turn the 2- 
D representation into a solid object. This technique necessarily incurs a loss in 
data structure, and a triangle is a relatively complicated mapping, particularly in 
higher dimensions. To understand the limitations of this method this mapping is 
presented for the circular function in Figure 6 and can be compared directly with 
Figure 5, except that the extent of the colour map is reduced in the triangular 
representation. Additional points outside the triangle could also be obtained by 
extrapolation. Note that in Figure 6 the optima at x=[6,0], x=[5,2] and 
x=[2.1 16,4.1 74] form the corners. Intermediate points are obtained by 
interpolation. Although this transformation could provide some appreciation of a 
high dimensional space the problem with it is that the space extent is unknown. 
As such it can be used to appreciate space around known points in the domain, 
but whether all the optima are captured or the required amount of space has 
been visualized is not known. 

A transform is required which has a better 2-D manifold. The SOM is a 
projection and visualisation of a high-dimensional signal space on a two- 
dimensional display. Therefore it should be possible to use the SOM rather than 
a triangle for the 2-D manifold. Returning to the SOM it is clear that the 
tessellated hexagons used previously are relatively coarse. In fact, a much finer, 
rectangular definition is possible. The equivalent SOM to Figure 5 is next shown 
in Figure 7. However, the SOM is found not to give very good results and the 
mapping from topographic space to the data space is only defined at the location 
of the nodes. 

The Generative Topological Mapping (GTM) is intended as an alternative 
computation of the SOM, in an attempt to define the metric relations between the 
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models on the map grid with improved fidelity to those in the data space. The 
trade-off is a higher computational cost. The equivalent GTM to Figure 5 is 
shown in Figure 8. The orientation of these maps is always somewhat arbitrary, 
so rotation through 90 degrees anticlockwise shows a very similar representation 
compared to Figure 5. This transformation will now be applied to a military aircraft 
design problem. 

Military Aircraft Design P roblem Specification 

The problem is to minimise the drag coefficient (C D ) of a representative 
Military Aircraft trapezoidal body/wing tail-less aircraft in cruise at M=0.85, 
subject to: 

5-D Problem: 

-3.0 £ wing linear twist (washout, 9) < 7.0 
-3.0 £ wing angle of attack (a) < 7.0 

0.0 £ mid - camber < 0.07 

0.0 £ flap deflection angle (5) £ 10.0 

9.557 < leading edge tip location £ 1 4.227 

C L Z 0.1994 

C mtaaJ = C mit + hC L cos a +hC D sin a 
C *+ g 3 = 1.0 

1 c 

— — tana+^3 
hcosa 

8-D Problem: 

-0.01 < Root Camber at 30%c <, 0.025 

-0.01 £ Root Camber at 60%c £ 0.04 

-0.01 < 50% Semi-span Camber at 30%c £ 0.025 

-0.01 < 50% Semi-span Camber at 60%c £ 0.04 

-0.01 < Tip Camber at 30%c £ 0.025 

-0.01 <> Tip Camber at 60%c <> 0.04 



0' £ a £ T 

subject to the constraints: 
C L >0. 1994 and |CJ<0.02 



14-D Problem: 
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-0.01 £ Centre line Camber at 20%c £ 0.02 
-0.01 < Centre line Camber at 40%c £ 0.03 
-0.01 < Centre line Camber at 70%c ^ 0.03 
-0.01 < 40% semi-span Camber at 20%c £ 0.02 
-0.01 < 40% semi-span Camber at 40%c < 0.03 
-0.01 £ 40% semi-span Camber at 70%c £ 0.03 
-0.01 £ 70% semi-span Camber at 20%c £ 0.02 
-0.01 70% semi-span Camber at 40%c £ 0.03 
-0.01 £ 70% semi-span Camber at 70%c £ 0.03 
-0.01 < Tip Camber at 30%c <> 0.02 
-0.0 1 £ Tip Camber at 50%c £ 0.03 
-0.01 < Tip Camber at 60%c £ 0.03 

r < a <, r 

subject to the constraints: 
C L >0.1994and |C m |<0.02 

where C L is the lift coefficient and C„ the pitching moment coefficient 

. 5 CFD evaluations are performed using the BAE SYSTEMS in-house code 

FLITE3D [8] in inviscid, Euler mode. 

Visualisation 

Figure 9 shows a visualisation of a related two-dimensional design space, 
with computational noise and failed evaluations. (Here, a simpler solver is used 

10 with two trailing edge parameters to reduce the computational cost so that a large 
number of evaluations is possible.) This corresponds to 50x50 evaluations of a 
two-dimensional design space (C D at C t =0.7Y, M=0.74) using a 2-D panel 
method. The two-dimensional design space describes the vertical movement of 
two B-spline poles adjacent to the trailing edge of an aerofoil. Computational 

15 noise often causes ridges in the design space, see also, for instance [9]. It is 
clear that gradient searches in this domain will not find the global optimum, but a 
local one, stopping at the bottom of a ridge. These problems are likely to be 
amplified in higher dimensional space. Inability to visualise high dimensional 
spaces can lead to an inability to fully exploit the additional flexibility. 

20 Computational noise and expensive evaluation naturally leads to the use of 
response surface methodologies in design space optimisation. 
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Figure 10 shows the scatter plots for the 5-D military aircraft problem. In 
these, for instance, the quadratic nature of the relationship between C L and C D of 
every dependent and independent variable in the 5-D problem against every 
other variable can easily be identified. Additionally the independent variables 
show no relation with each other as should be expected given the DoE used to 
collect the data. 

Figure 11 shows a set of SOM's for the 5-D military aircraft problem. To 
orient oneself with the SOM's it is necessary first to look at the picture of the 
glyphs shown top right. In this image, each of the glyphs is placed according to 
the value of a, 0and 5 and are coloured according to the value of C L . The SOM 
is a diagrammatic representation rather than a physical map of the design space, 
as illustrated by comparison between the SOM of C L and the glyph image: the 
trends of the data are the same and have similar features. Consider the C L SOM 
tile, it varies from red through green to purple across the diagonal. In the glyph 
image, the same variation can be seen from top left to bottom right. In the SOM's 
the diagonal trends of the maps of Co, C u C m , trim and a show that they are all 
related (C D , C L , a monotonically and inversely to C m ahd trim). The SOM's also 
show that the independent variables in the problem are unrelated, as they should 
be, given a suitable DoE. In higher dimensional problems, the SOM has been 
shown to indicate the first two principal components, as their SOM's can be 
related although in opposite directions (e.g. in opposite diagonal directions or 
vertically and horizontally). Bland regions in the SOM give an indication of rogue 
data (e.g. from unconverged CFD evaluations) and completely bland SOM's can 
help to identify unimportant variables. 

Figure 10 and Figure ^ 1 are not easy to interpret, and the next question is 
whether or not the type of visualisation presented in Figure 2 can be extended to 
higher dimensions to provide equally useful information. 200 CFD evaluations 
were used to obtain the Krig. Figure 12 shows a hierarchical axes techn.que 
(HAT) plot after [15] noting that filled squares denote optima located in the model 
using different optimisation methods. The dther squares show the locations of 
evaluations in the final stages of simulated annealing of the response surface. 
The value of C D is coloured within the tile. Colouring does not take place if the 
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inequality constraint on C L is violated. The contour lines are contours of trim 
constraint. As shown in the Figure, within an individual tile camber and S vary. 
As one goes from tile to tile in the horizontal direction of the main plot 0 varies 
and in the vertical direction a varies. Then the top 81 tiles of this image represent 
the highest value of the fifth design variable, leading edge tip location. Each block 
of 81 tiles going down then represent lowering values of leading edge tip location. 
Only the top of this image is presented so that the smaller tiles are seen clearly. 
Two optima are shown: the first the result of a simulated annealing optimisation 
(red square) and the second the result of an exhaustive search in the 
representation data. This visualisation is similar in spirit to the triangles used in 
Figure 6 and [16], but with a less complex design space transformation. The HAT 
plot can however, only be used for data appreciation in up to 6 dimensions, as 
the tiles become too small thereafter. This picture is only possible because 
response surface methodologies enable the large amount of data required for 
plotting to be provided. The image gives confidence that the same optimum is 
being located in both cases and that the curve fit is well behaved. 

Results from the RSM Kriging Process 

To validate the RSM Kriging procedure some results from this process are 
given in Table 1 . The variation in the results given in Table 1 could be cause for 
concern, except that reference to the visualisation shows that these results are 
close to each other and are therefore close to the same optimum. The CFD result 
is significantly different from the RSM, which means that there is mileage in 
building a new model, including this optimum and iterating until the optimum and 
CFD result obtained converge. The loading distribution and geometry of the final 
configuration are shown in Figure 14. In this case the loading distribution is 
nearly elliptic, as required, except for the compensation for wave drag in the 
outboard wing. The sweep is reduced compared to the initial configuration as 
large amounts of sweep give a large amount of downward pitching moment, 
which has been reduced. During a large number of optimisations of similar 
design spaces, in general there seem to be two optima in these design spaces. 
The second is an optimum in which the result is below the elliptic loading 
distribution at the root and above it at the tip. This has a deleterious effect on root 
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bending moment {Lb. increases it) and hence the structural optimum is worse 
and so in general the aerodynamics community chooses the answer presented 
here. 

The GTM in the 5-D problem 

Instead of Kriging the three design parameters of interest separately, in 
the SOM and GTM all the parameters of interest: the design variables, the 
objective and the constraints are transformed into the lower dimensional space 
y(x,W). The thesis in which the GTM is developed [18] offers the visualisations 
posterior mean and mode projection, the responsibilities and the magnification 
factors. This latter plot is a single image representing y(x,W). However, instead 
the inventors use the individual components of the vector y(x,W) pertaining to the 
variables of interest in the problem. From these components the penalty function 
can be obtained and plotted, with contours of C L and trim, where p(x) is given 
by: 

/,(*)= C D +\c l -l.0\+<{C Iml -C L )/C luui > t 

Where <> are MacCauley brackets, in which the contents become zero if 
the function therein is negative, else the value of the function is used. 

Figure 13 shows an image map representation of transformed data in 2-D 
latent design space y (x,w) in accordance with an embodiment of the invention. 
More particularly, this image map representation is provided by application of the 
GTM transformation for the 5-D aircraft design problem. Note that the penalty 
function is shown in the Figure, obtained from a combination of latent spaces for 
C L , Co and C m , with contours of the latent spaces of C L and trim. The cross 
marks the optimum, that is the point where C D is the lowest and both C L and trim 
are satisfied. Here, a 60x 6 o -jatent space of isxis radial basis function (RBF) 
centres was used. Transformation back into real space gives the corresponding 
values of x 1t x* x 3 , x 4 and x 5 . These results are given in Table 2. The agreement 
between the CFD and GTM is excellent and the result is better than the 
preliminary result obtained using Kriging. Comparison between the GTM and 
Kriging results is .also shown in Figure 14. This Figure shows a loading 
distribution of optimised wing design using kriging and the 5-D inventive GTM in 
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accordance with an embodiment of the invention. Also shown are the starting 
and final CFD models. The GTM result is better as it is closer to an elliptic 
loading distribution. The new point could also now be used to build a new GTM, if 
desired, as the optimum could be used to build a new Krig model. 

Use of the GTM for higher dimensional optimisation 

The GTM was also used to optimise aerodynamic design spaces in 8 and 
14 dimensions. In both cases a 60x6olatent space was used with 30x30 RBF 
centres. The visualisations are shown in Figure 15 and Figure 16 respectively. 
Note that Figure 15 is shown orientated in such a way to show similarity to the 
14-D GTM shown in Figure 16. The solution to the 8-D problem is at 0.05058, 
x 2 = 0.01256, x 3 = 0.005531, x 4 = 0.00668, x 5 = 0.00953, x 6 = -0.00360, x 7 = 4.8462, 
x 8 = 1.7266, with the GTM model after a number of iterations and the CFD 
solution being C L = 0,2022, C D = 58.83 counts, C m = -0.00359661. This is 
probably reasonable compared to other optimisations, for instance a 3-D gradient 
search also gave C D = 58.8 counts, with C L =0.1994 and C m =-0.02 (higher C L and 
lower C m in this case), although there is probably more to come as the GTM 
solution is not on the boundary. This could possibly be found using a gradient 
search. The GTM in conjunction with an optimisation method does not seem to 
work as well in 14-D as in lower dimensions. It is probable that this is because 
the transformation is doing more Le. going from 14-D to 2-D. To ameliorate this it 
should be possible for higher dimensions to transform to 4-D and view using the 
HAT plot discussed previously. The distinct similarities between Figure 15 and 
Figure 16 are evident and significant because they show that the same problem 
is being solved in both cases. It may assist in the future when trying to ascertain 
whether or not more limited sets of design variables can be used to adequately 
represent problems to compare the 2-D design spaces of both the lower and 
higher dimensional representations of the problem. 

Other Potential Applications of the GTM in Design 

During the kriging process it is possible to merge high and low fidelity data 
results. Plots of such data would show similarities and differences in the GTM. 
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Previous work has considered the use of the GTM in design space search, 
see [19]. However, here the SOM and GTM are used to predict how a low fidelity 
model relates to a high fidelity analysis. This inventive work does not consider the 
optimisation process per se in the lower dimensional representation. In [19] El- 
Beltagy indicates that the GTM algorithm can also be used as a visualisation tool 
to understand the discrepancies between the models and so reformulate the 
optimisation problem, although he does not show how. 

Conclusions 

A 2-dimensional plot generally provides the best data visualisation. 
Multiple dimension data needs to be transformed to lower dimensions to enable 
this. The HAT plot visualisation along with the RSM technology enables 
visualisation in up to 6 dimensions. The GTM has been shown to provide 
adequate visualisation and a quantitative graphical method for optimisation up to 
14 dimensions. However, the step from 14-D to 2-D may be too large and 
therefore, a 4-D GTM may be more accurate. More points in the 14D RBF and 
latent space may also improve the GTM. 

Visualisation technology helps the designer to spend time inspecting 
results and ensuring correctness rather than dealing with large volumes of flow 
data. After a large number of numerical evaluations have been performed there is 
a need to identify any off trend results. The scatter plot method presented here is 
ideal for this purpose. The SOM also helps with this to give an overview. 
Response surface method technology eliminates inefficient design space 
sampling in the final stages of a gradient search optimisation. A balance is 
required between the number evaluations in the DoE, the number of cycles in the 
CFD, the number of points in the initial DoE and the number of further 
evaluations used. The trade-off between low-dimensional comprehension and 
high-dimensional accuracy impacts optimisation. 

- These type of visualisation methodologies are utilised to support design 
decisions such as the relative scaling of the design variables and constraints and 
choice of penalty function', which are important in optimisation. Also possible is 
the recognition of problems such as numerical noise and boundaries of 
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evaluation failure. Initial design of experiments can be improved in a systematic 
way by calculation of additional points dictated by maps of statistical and other 
error criteria. Significantly, the invention has utility for various aircraft design 
applications. Also, the invention can be embodied in software, if desired. 
5 Although this technology has been developed with reference to aircraft 
aerodynamic design in particular, the design space visualisation and curve-fitting 
technology developed is general. It should therefore be equally applicable to 
other disciplines such as cost analysis, structures and computational 
electromagnetics, in which expensive analysis tools are used to find optima for 
10 complicated design problems. It is expected to be particularly useful in multi- 
disciplinary design and situations where there are multiple optima in the design 
space. 

Having thus described the present invention by reference to several 
preferred embodiments, it is to be appreciated that the embodiments are in all 

15 respects exemplary and that modifications and variations are possible without 
departure from the spirit and scope of the invention. For example, whilst in the 
described embodiments the transformed data in the low-dimensional (2-D) image 
map representations are visually inspected, it is equally possible for the 
inspection to be performed computationally. It is to be also understood that the 

20 described inventive transformation technique can be effectively applied to a wide 
range of high-dimensionality design spaces and that the transformation of data 
can be suitably performed into any one of a wide range of low-dimensionality 
design spaces. 

It is to be also appreciated that whilst the GTM transformation technique is 
25 applied in the described exemplary embodiments, it is equally possible to use 
alternative transformation techniques, SOM for example, instead of GTM, so as 
to realise the inventive technical effect. 
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Appendix 1 Kriqinq 

Here, a Kriging approximation using a Gaussian kernel has been used to 
perform the RSM surface fits, see for instance in Sacks [5] or Jones [6,7]. If y is 

an (nx1) vector of responses evaluated at the locations x t , M n, where n is 

the size of the DoE, then the response at the unsampled points X* is an 
estimate given by: 

j)(x*) = t I+r r R- 1 (y-l^) 

where: 

1 is the vector of ones and ^ is a weighted mean given by: 

, i r R y 

^"l^R" 1 ! 

with: 

r being a correlation vector based on the measured and estimated 

sample points, X * , 

R is a matrix of correlation coefficients, based on the data points 

the (Uf entry of *is given by Corr ^ X ^ and the element of 

r b y Corr [ x n+i> x i] with: 

* Ph 
Ci»T[^,x / ] = eaq)[-£lO*|x w -x JfcJ ] 0, > OJ = l,...,k t 



/i=i 



for a sample of k variables at n points. 

The hyperparameters 0 h , Ph and the factor on w mln in SVD (if used) are 
optimised by maximising the likelihood function or minimising: 
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- - I 

2 



~2 . 



Where the variance, or , is given by: 

n 

Giving the mean square error of the predictor as: 



S 2 (X*) = <7 2 



jr n -* , (l-^R-V) 2 



l-r'R'r 



1 T R _1 1 



Finally, the expected improvement is given by: 



£[/(x*)] = 



if the constraints are satisfied 
else 



Here, y min is defined as the minimum of the input data, which satisfies the 
constraints. When considering minimisation, Expected Improvement can have its 
maximum value where the data is sparse or the approximation has a low value. 
The strategy is to resample where the Expected Improvement is maximised, then 
to form a new approximation and repeat. 

Where the standard normal density and normal distribution functions are: 



i — 



4ln 



and 



du 



If the Euclidean norm is given by ||z||the linear and thin plate spline radial 
basis functions are given as: 



Corr[x.,Xj] = ||z 



Corr[x„Xjl = \±f log(||z||) 
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These Equations do not provide kernels suitable for tuning or error 
analysis with statistical interpretation. It should be noted that alternative kriging 
algorithms are also widely used, which use the variogram instead of the 
correlation, see for example [17]: 
Appendix 2: Summary o f the GTM algorithm 

The GTM is a non-linear parametric mapping y(x,W) from an L-dimensional 
latent space to a D dimensional data space, where normally, L<D, as illustrated 
in Figure 17. The sequence of steps for constructing a GTM model is given in 
[18] as: 

Generate the grid of latent points: {* k } » * = * * • iK ' 



Generate the grid of basis function centres: 

Select the basis function width er. 

Compute the matrix of basis function activations, O. 

Initialise W, randomly or using PCA. 

Initialise p. 

If desired, select a value for a. 

Il2 



Compute A, A kn = |K-<I> ft W 
Repeat 

Compute R using A and p. 
Compute G using R. 



E-step 



W = (O t GO + XI)" 1 <D T RT, where X may be zero. 
Compute A, A kn = ]f.-^W| 
Update p, using R: and A. 



M-step 



Until convergence 
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The squared distances required to update in the M-step gets 'reused' 
when calculating the responsibilities in the following E-step. In our case we use 
the implementation of this formulation by Ian Nabley of Aston University in 
Netlab, [20]. 
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CLAIMS 

1 . A method of transforming data from a high-dimensional to low-dimensional 
design space and deriving an optimum value for a predetermined function 
representative of the transformed data in the low-dimensional design 
space, which derivation is further effected in the low-dimensional design 
space in dependence upon an inspection of the transformed data. 

2. A method of transforming data from a high-dimensional to low-dimensional 
design space, and deriving a conditional value for a predetermined 
function representative of the transformed data in the low-dimensional 
design space, which derivation is further effected in the low-dimensional 
design space in dependence upon an inspection of the transformed data. 

3. A method as claimed in claim 1 or 2 wherein the value is derived by (a) 
establishing a mathematical combination of a number of independent 
design variables and dependent design variables relating to the function, 
and (b) modifying said combination in the low-dimensional design. space to 
derive therefrom the desired value for the function at which various 
constraints associated with the function are satisfied and at which the 
function has a conditional high or low value in relation to other possible 
values of the function which are determined in accordance with the 
modification of said combination. 

4. A method as claimed in claim 1, 2 or claim 3 wherein said transformation 
into the low-dimensional design space is performed by application of a 
Generative Topographic Map (GTM) technique. 

5. A method as claimed in any preceding claim, comprising the step of 
transforming data from a first high-dimensional design space and from a 
second, different high-dimensional design space into a low-dimensional 
design space, comparing the different transformed data sets in said low- 
dimensional design space and identifying therefrom similarities between 
the different transformed data sets to indicate a correspondence between 
the first and second high-dimensional design spaces. 
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6. A method as claimed in claim 5 wherein the first high-dimensional design 
space is a 5-dimensional design space, the second high-dimensional 
design space is an 8-dimensional design space, the third is a 14- 
dimensional design space, and the low-dimensional design space is a two- 

5 dimensional design space. 

7. A method as claimed in any of claims 3 to 6 wherein the data 
transformation into the low-dimensional design space is performed in a 
manner Which takes account of the effect of each of the design variables 
relating to the function. 

10 8. A method as claimed in any preceding claim wherein the value derivation 
is effected by generating an image map representation of the transformed 
data in the low-dimensional design space, and visually identifying an 
intersecting region in the image map representation, which intersecting 
region provides an indication of said value. 

15 9. A method as claimed in any preceding claim for application to an aircraft 
design or to an aerodynamic surface design. 

10. A method substantially as herein described with reference to the 
accompanying drawings. 

11. A program element comprising program code operable to carry out a 
20 method as claimed in any preceding claim. 

12. The program element of claim 1 1 on a carrier medium. 

1 3. A data processing system for transforming data from a high-dimensional to 
low-dimensional design space adapted and arranged to carry out a 
method as claimed in any preceding claim. 

25 14. A data processing system substantially as herein described with reference 
to the accompanying drawings. 
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ABSTRACT OF THE DISCLOSURE 
DESIGN BY SPACE TRANSFORMATION 
FROM HIGH TO LOW DIMENSIONS 

A method is provided for transforming data from a high-dimensional to 
low-dimensional design space, and for inspecting the transformed data in such a 
manner as to permit effective navigation and exploration of the high-dimensional 
design space. Conveniently, an optimum/conditional value for a prescribed 
functional representation of the transformed data can be derived by visual 
inspection of a 2-D image map representation of the transformed data. 

Significantly, the invention has utility for various aircraft design 
applications and although this technology has been developed with reference to 
aircraft aerodynamic design in particular, the design space visualisation and 
curve-fitting technology developed is general. It should therefore be equally 
applicable to other disciplines such as cost analysis, structures and 
computational electromagnetics, in which expensive analysis tools are used to 
find optima for complicated design problems. It is expected to be particularly 
useful in multi-disciplinary design and situations where there are multiple optima 
in the design space. 
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